Estimation of Lyapunov spectra from space-time data 
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A method to estimate Lyapunov spectra from spatio-temporal data is 
presented, which is well-suited to be applied to experimental situations. It 
0^ ■ allows to characterize the high-dimensional chaotic states, with possibly a 

large number of positive Lyapunov exponents, observed in spatio-temporal 



chaos. The method is applied to data from a coupled map lattice. 
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^ ■ Nonlinear spatially-extended systems (SES) attracted a vast research activity in nonlin- 

ear dynamics, partly because of their ability to exhibit high- dimensional chaotic motion, 
1-^. with possibly a large number of positive Lyapunov exponents (for an overview on SES see 
^ ! Established dynamical models for SES are partial differential equations (PDE) for sys- 

I tems continuous in space and time, and coupled map lattices (CML) for systems discrete 
' in space and time. The spectrum of Lyapunov exponents can be directly estimated from 
the models by numerical means. On the basis of the Lyapunov spectrum the Kaplan- Yorke 
dimension and the metric entropy can be estimated. Along these lines, an extensive scaling 
of the Lyapunov spectrum, as well as the Kaplan- Yorke dimension and the metric entropy, 
5^ I with respect to the system size has been observed for several PDE- and CML- models 0. 

The term 'spatio-temporal chaos' has been coined to describe this phenomenology. Ad- 
ditionally, various well-controlled experiments to investigate the nature of spatio-temporal 
chaos were conducted. Unfortunately, it was not possible to directly extract the Lyapunov 
spectrum of the experimental systems from the space-time data so far, since one has to 
find an appropriate nonlinear model first. Typically, this is done by using a time-delayed 
embedding (of high enough order) to construct a phase space from a scalar measurement 
0. Then, the time-dependent Jacobian can be estimated from the data. Unfortunately, one 
faces two problems for relatively high dimensions of phase space (i. e. D > 6): (1) An expo- 
nentially increasing number of data is required. (2) The delay embedding induces a folding 
in phase space, which makes it increasingly difficult to perceive a deterministic structure 
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1^. For the above reasons the estabhshed techniques for the estimation of Lyapunov spectra 
are restricted to chaotic states with a small number of positive Lyapunov exponents (say 
smaller or equal to 3). Besides that spatio-temporal chaos was characterized by the 
decomposition into spatial modes such as the Karhunen-Loeve decomposition 

In this paper we address the question of how to estimate the spectrum of Lyapunov 
exponents of a SES from space-time data, which could i.e. be the output of an experiment. 
Typically, the equation of motion is unknown. Recently, novel methods for modelling SES 
on the basis of models with a purely local coupling (PDE, CML) were established 
We show how the latter local models can be used to estimate the Lyapunov spectrum of a 
SES from space-time data. Then, we apply the method to space-time data of a CML and 
compare the results to the theoretical prediction. Finally, we show how the method can be 
used to investigate boundary effects and the 'universal' nature of the Lyapunov spectrum of 
a homogeneous SES. 

Let us recall the definition of the spectrum of Lyapunov exponents of a non-autonomous 
dynamical system 

Xn+l = fiXn^Vn), (l) 

where x„ G 7^^,y„ ^ '^'^ is an external driving force, and / : 71^^'^ IZ^ . For the ease of 
presentation we restrict the following discussion on time-discrete systems. The spectrum of 
Lyapunov exponents Aj, z = 1, / of the system (|I]) is defined as the contraction rates of a 
volume element averaged over the attractor ||,|lOl: 

A.(xo,y„)= hm ;^ln|Af)|, (2) 
where A^^'' are the eigenvalues of the product of all Jacobians J„, = ^{xn,yn)'- 
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n JnuP = Af (3) 

n=l 

In general, the spectrum depends on the initial state xq, and the sequence of inputs yn- 
In special cases, these dependences can be removed with the help of multiplicative ergodic 
theorems. It has been shown that in the autonomous case (y„=0), as well as for random 
inputs i/n the limit exists and only depends on the invariant measure @,1C]. In basically 
all relevant cases the Lyapunov spectrum Aj cannot be computed from the equations (|I])- 
directly and one has to rely on numerical estimations of the Lyapunov spectrum. A well- 
established technique for its estimation from time-evolution equations (|I|) is described in 
0: The trajectory as well as / perturbation vectors are iterated numerically (with the help 
of the time-dependent Jacobian J„). A successive orthonormalization of the perturbation 
vectors prevents them from alignment. From the Lyapunov spectrum important invariant 

quantities can be estimated: 1) The Kaplan- Yorke dimension, Dky = k + p^=^ | ' , where 

Y.i=i Aj > and J2i=i Aj < 0. 2) An upper bound for the metric entropy via the Pesin 
formula, h = J2i^=i -^i? where A^"*" is the number of positive Lyapunov exponents. 

At first we concentrate for simplicity on discrete, scalar systems, with a local coupling 
only, which are modeled with the help of coupled map lattices (CML). The cases of con- 
tinuous dynamics in space and time, as well as multi-component systems can be treated 
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analogously and will be discussed at the end of the paper. Let the experimental data {x^} 
be a measurement of a homogeneous, scalar spatially-extended system with a discrete spatial 
variable i = 1, / and a discrete time n = 1, ..n = 1, .., N. The overall number of data is 
NI. If the unknown equation of motion of the system under investigation is a CML with a 
local couphng of range m, the data can be modeled by 

<+i = M^j, (4) 

with = (x^-'", . . . , and h : 7^2™+l ^ 7^, for i = m + 1,..,/ - m. The 

system is non-autonoumous, since it is driven by the variables at the boundaries 
(x^, . . . , x™, x^""^, . . . , x^). The phase space of such a system has (A^ — 2m) dimensions, 
allowing for a high- dimensional chaotic motion with possibly a lot of positive Lyapunov 
exponents. Nevertheless, the restricted couplings of the variables in phase space - as it is 
expressed by the function h, which couples only four values of the space-time data - allows 
to obtain a nonlinear, deterministic model in a (2m -|- 2)-dimensional space only. It is of 
fundamental importance to statistically verify the model class (^) on the basis of the data 
with appropriate tools, which also allow to estimate an appropriate coupling range m. Since 
this has been described in detail elsewhere, we refer to the literature 0-^. 

In this paper we use a local linear model h{v^^) = o^-i^-t-fe^, where the parameters (a^, 6^) 
can be obtained for each time n,n = 2, N and each position i,i = m + 1, — mhj the 
minimisation of the distance 
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X'n+i-Hvi^)) , (5) 



of the data to the local linear model with the help of a local least squares fit. is a 
sufficiently small neighbourhood of with the cardinal number Njji^. Since the model h 
is homogeneous, appropriate neighbors can be chosen with respect to a varying time n as 
well as a varying position i. This allows to treat every space-time point x^ (except at 
the boundaries) on the same basis and to vastly enhance the statistics and decrease the 
requirements on the number of data by averaging over space and time. The local linear fits 
have been chosen for practical purposes; we note that in principle any appropriate method 
for nonlinear fitting can be used. 

As a consequence of the local coupling, the Jacobian J„(x^, . . . , x™, x^~™, . . . , x^) of a 
SES has the form of a (2m + l)-diagonal matrix, which in the case of a CML-model (^ 
reads, 

^^:'^ = \ eLf.-,^ .^L (6) 



for i, j = m + 1, .., I — m. In the case of a local linear fit for h, the non-zero entries of the 
Jacobian (^ are given by the coefficients o^. Let us recall that the spectrum of Lyapunov 
exponents (0) depends on the sequence of inputs, which in the case of SES are the boundaries. 
While in priniciple, this dependence on the sequence of inputs at the boundaries cannot be 
removed, we found some evidence that if the investigated system is part of a larger system, 
which displays homogeneous spatio-temporal chaos, the Lyapunov exponents do not depend 
on the sequence of inputs at the boundaries. This will be discussed in more detail later. 
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We performed several tests of the above presented method for estabhshed models of SES. 
At first, we present results on the estimation of Lyapunov spectra for a lattice of coupled 
logistic maps 

= (1 - 2e)/(xt,) + e{f{xl') + (7) 

with /(x) = 4x(l — x), from space-time data {x^}, n = 1, 10, 000, z = 1, 50 with fixed 
boundary conditions = = 0.1 and e = 0.2. In this case, since the boundary conditions 
are fixed, the system is autonomous with a 48-dimensional phase space. The first step is to 
identify the data {x^} to be governed by a local model (^) and to estimate the appropriate 
value of the coupling range m. Since the estimation and verification of local models from 
space-time data has been already described in detail, we refer to the literature [0-0], and 
from now on consider the model (^) to be verified. The function h was modelled with a 
local linear model under varying m, the neighborhoods were chosen such that at least 
30 points were contained. The coefficients of the Jacobian J„ were extracted according to 
(^). We propagated (50 — 2m) perturbation vectors in time according to the fitted Jacobian 
Jn and orthonormalized the perturbation vectors after each time step. The spectrum of the 
Lyapunov exponents was computed as a mean over the logarithms of the stretching factors 
of the propagation vectors (for details see 0). We compare the results to the estimation 
of the Lyapunov spectrum from the equations (|^) As presented in Fig. 1. we find a good 
agreement of the spectra for m > 1. The estimation of the exponents for m = does 
not yield a meaningful result and therefore the (m = 0)-model has to be rejected. Since 
the Lyapunov spectrum under variation of the coupling range m converges for m > 1, we 
propose the convergence of the LS as another criterion for estimating m. In Table 1 we 
compare the dimension, the entropy and the maximum Lyapunov for m = 0, 1, 2. 

Our approach of a non-autonomous model (1) allows to estimate Lyapunov spectra not 
only in the case in which all variables i = 1,...,/ are observed, but also for incomplete 
observations in space i = io, ...,io + l — l. The so-defined subsystems of length / are driven by 
the input sequences at the boundaries {x^°, . . . , x^^"*"™", xj^"^'"™', . . . , x^"'^'^^), where in general 
the Lyapunov spectrum also depends on. Therefore, the dimension of the phase space is 
/ — 2m and the dimension density S is calculated as (5 = ^f^, and the entropy density r] is 
calculated as ?7 = jz^- 

At first, we present results of the estimation of the dimension density 6 and the entropy 
density rj for such a subsystem under variation of the length of the subsystem / in Fig. 2. 
The data were taken from a CML with e = 0.3 and the total length I = 100, starting at 
io=40. For the estimation of the Lyapunov spectrum an observation time = 20, 000 was 
taken into account. We focus on a model with m = 1. One finds a convergence of the 
dimension and the entropy for larger values of /, as one expects for extensive systems. 

Furthermore, we estimate Lyapunov spectra of subsystems {x^},i = io, ...,io + / — 1 of 
the SES (^) with a varying spatial offset io and length Z = 10. With this, we unveil the 
effects of boundaries as well as the independence of the spectrum sufficiently far away from 
the boundaries. The latter effect can be used to estimate the spectrum of a large SES from 



a small subsystem only [p!T| , p!2| . The subsystem of length Z = 10 is taken from a CML 
(0) of length (/ = 100) with fixed boundary conditions and e = 0.3. For the estimation 
an observation time A^ = 20, 000 was taking into account. We find that the Lyapunov 
exponents approach limit values for large enough offset io, while the values of the exponents 



4 



are significantly decreased in the vicinity of tlie boundary. From tlie spectra tlie dimension 
density 6 = Dky/1 and tlie entropy density r] = h/l, where h is the metric entropy, are 
estimated as shown in Fig. 3. For > 5 we observe a plateau of the dimension and the 
entropy in the limits of the statistical errors of the estimations. For < 5, both quantities 
are decreased as an effect of the fixed boundaries of the system. While the dynamics as 
well as the input sequence at the boundaries of all the subsystems are different for different 
spatial offsets io, we find a 'universal' Lyapunov spectrum sufficiently far away from the 
boundaries. We take the latter results as an evidence that the Lyapunov spectra of the non- 
autonomous subsystems are independent of the external driving at their boundaries in this 
case. Therefore, the Lyapunov-spectra of a subsystem of a homogeneous SES, sufficiently far 
away from the boundaries only depends on the size of the subsystem and is an appropriate 
tool to characterize the dynamics of the subsystem as well as the larger system itself as has 
been conjectured by Grassberger [|13| . 

Until now, we described the technique to estimate Lyapunov spectra of SES from space- 
time data on a rather fundamental level. In the following we shortly comment on more 
general cases. A more profound discussion will be presented in a subsequent paper. The 
next step is to also consider CMLs in 2 and 3 spatial dimensions: The increase in spatial 
dimensions immediately implies an increase of the number of nearest neighbors. Addi- 
tionally, the structure of the Jacobian will be such that there are several diagonals with 
non-zero entries, which are separated by diagonal bands of zeros. Also the investigation of 
non- homogeneous systems must be taken into account. In this case the model in eq. 
depends on the space, h = hi, as well as the partial derivatives of the model in eq. @. 
A non-homogeneous model hi does not introduce any conceptual problems, but a larger 
number of data is required since the average over space and time for the fitting of the model 
as applied in our example, cannot be applied for a non-homogeneous model. For practical 
purposes it is by far more interesting to estimate the Lyapunov spectrum of SES continuous 
in space and time as modelled by PDEs. The identification of PDEs from experimental data 
involves the estimation of derivatives with respect to space and time as shown in 0J^. For 
the estimation of the Lyapunov spectrum though, one has to introduce some appropriate 
discretization in space and time, as it is common in the case of the estimation of Lyapunov 
spectra from a PDF directly. After the discretization, the procedure evolves along the same 
lines as described for CMLs, where the model h of the time-evolution equation takes 
the form of a discretized PDF, while an additional dependence of the Lyapunov spectra 
on the discretization in space and in time has to be taken into account. In the case of a 
A^-component CML or PDF with N > 2 (the state space dimension is A^), the measurement 
of A^-component space-time data is required for the estimation of the Lyapunov spectrum. 
The important problem of how to identify and characterize a A^-component SFS from a 
scalar space-time measurement is subject to current research. 

We acknowledge helpful discussions with M. Abel, A. Giaquinta, H. Kantz, J. Parisi, 
A. Politi, and H. Voss. M. J. B. is supported by a Marie-Curie-Fellowship of the EU with 
the contract number: ERBFMBICT972305. R. H. is partly supported by the EU with the 
contract number: ERBFMRCT96.0010 and wants to thank the colleagues at the INO for 
their kind hospitality. 



5 



[1] p. C. Cross, M. C. Hohenberg, Rev. Mod. Phys. 65 (1993) 851. 
[2] D. Ruelle, Comm. Math. Phys. 87 (1982) 287. 

[3] H. Kantz and T. Schreiber, Nonlinear time series analysis (Cambridge University Press, Cam- 
bridge, UK, 1997). 
[4] E. Olbrich and H. Kantz, Phys. Lett. A 232 (1997) 63. 

[5] A. Torcini, A. Politi, CP. Puccioni, G. D'Alcssandro, Physica D, 53 (1991) 85. 
[6] S. M. Zoldi, and H. S. Greenside, Phys. Rev. Lett. 78 (1997) 1687. 
[7] H. Voss, M. J. Biinner, and M. Abel, Phys Rev. E 57 (1998) 2820. 

[8] U. Parlitz, Nonlinear Time-Series Analysis, in: Nonlinear Modeling - Advanced Black-Box 

Techniques, Eds. J.A.K. Suykens and J. Vandewalle, Kluwer Academic Publishers, Boston, 

(1998) p. 209-239. 
[9] M. Bar, R. Megger H. Kantz, Phys. Rev. E 59 (1999) 337. 
[10] M. Casdagli, in Nonlinear Modeling and Forecasting, SFI Studies in the Sciences of Complexity 

(Addison- Wesley, Reading, MA, 1992). 
[11] R. Carretero-Gonzalez, S. Orstavik, J. Huke, D. S. Broomhead, J. Stark, preprint server 

chaodyn/9807038. 
[12] N. Parckh, V. R. Kumar, and B. D. Kulkarni, Chaos 8 (1998) 300. 
[13] P. Grassberger, Physica Scripta 40 (1989) 346. 




10 20 30 40 

i 



FIG. 1. Lyapunov spectrum of a coupled map lattice of 50 sites estimated from the equations 
(solid line), and from space-time data with m = (dot-dashed line; divided by 10 for presentational 
purposes), m = 1 (dotted line), and m = 2 (dashed line). 
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FIG. 2. (a) Dimension density 5, and (b) entropy density rj as estimated from a system of total 
length / = 100 (at the site io = 40) with varying length I of the subsystem. 



0.68 



0.67 





0.062 



r 0.060 



0.058 ^ 



0.056 



0.054 



10 20 10 20 

h h 
FIG. 3. (a) Dimension density 5, and (b) entropy density r) as estimated from a subsystem of 
length / = 10 with varying distance io from the boundaries. The horizontal lines are the values for 
the densities taken at Z = 8 according to Fig. 2. 
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equation 


0.72 


0.085 


0.37 


data (m = 0) 




3.4 


3.6 


data (m = 1) 


0.72 


0.085 


0.37 


data (m = 2) 


0.70 


0.085 


0.37 



TABLE I. Estimation of the dimension density 5, the entropy density rj, and the largest Lya- 
punov exponent Xmax from the equations (first row), and the from the data (second row). 
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